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Abstract. In a recent paper, Alfonsi, Fruth and Schied (AFS) propose a 
simple order book based model for the impact of large orders on stock prices. 
They use this model to derive optimal strategies for the execution of large 
orders. We apply these strategies to an agent-based stochastic order book 
model that was recently proposed by Bovier, Cerny and Hryniv, but already 
the calibration fails. In particular, from our simulations the recovery speed of 
the market after a large order is clearly dependent on the order size, whereas 
the AFS model assumes a constant speed. For this reason, wc propose a 
generalization of the AFS model, the GAFS model, that incorporates this 
dependency, and prove the optimal investment strategies. As a corollary, we 
find that we can derive the "correct" constant resilience speed for the AFS 
model from the GAFS model such that the optimal strategies of the AFS and 
the GAFS model coincide. Finally, we show that the costs of applying the 
optimal strategies of the GAFS model to the artificial market environment 
still differ significantly from the model predictions, indicating that even the 
improved model does not capture all of the relevant details of a real market. 



1. Introduction 

For a long time, financial mathematics mainly focused on asset pricing, but the 
scope has been extended in the last years. One of the current topics of interest is 
the theory of optimal trading strategies for the execution of large orders. Here, a 
trader would like to purchas^ a huge volume of shares up to time T . Since the 
supply of limit orders for a certain price is limited, the trader will not be able to 
trade the whole order for the current price, but he or she will suffer from an adverse 
price movement. This additional price impact, induced by the trader's own trading, 
can be lessened if he or she gives the market time to recover; the best price returns 
to previous levels. However, the time interval [0,r] is assumed to be too short in 
order to wait for a full recovery of the market. The optimal execution problem asks 
for the optimal splitting and the optimal trading times to minimize the expected 
price impact. 

There have been several models to solve the optimal execution problem, moti- 
vated by empirical findings (for references see next paragraph); yet, since we do 
not know if these models capture all relevant features of real markets, we cannot 
be sure that the strategies work in reality, and tests on real markets would be an 
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expensive experiment. For this reason, microscopic market models are an excellent 
tool for testing theoretical models of optimal trading strategies. Based on assump- 
tions about the market participants' behavior, these models simulate the trading 
of financial assets on the level of single traders or orders [GB03i ,SFGK03. BCHOG] . 
The emerging price processes show typical features of real markets [ConOll IPB031 
I ATHL05] . Hence, microscopic models provide artificial, yet reasonable, market en- 
vironments that allow for applying optimal trading strategies without costs or risk, 
comparing the numerical results with the theoretical expectations and resolving de- 
viations by an improvement of the underlying market assumptions with respect to 
the empirical findings. In this paper, we exemplify how this approach can improve 
a solution for the optimal execution problem. 

All approaches to the optimal execution problem rely on two empirical findings 
that have been validated in many studies (see Sch08 , pp. 3, for a list of references): 
First, a large order has an impact on its price; second, this impact decreases in time, 
but it does not vanish completely. That implies the costs of all subsequent orders 
are infiuenced by the impact of a large order. These two effects are called tempo- 
rary and permanent impact. Many models implement these observations straightly 
|BL98|lAC0T|IHS05] : They consider a stochastic process that simulates the current 
best price evolving independently from the large trader's action in time, and two 
functions mapping the volume of a large order to the temporary or, respectively, 
permanent impact. When a large order is executed, the corresponding impacts are 
just added to the price. Yet, it is doubtful if the complex dynamics of limit order 
books (LOB), which underlie most modern markets, can be captured by looking at 
the best price only. Therefore, recent models attempt to take the dynamics of the 
whole order book into account. Obizhaeva and Wang introduced a model with an 
underlying block shaped LOB and calculated the optimal trading strategy in terms 
of a recursive formula by applying Bellman equations |OW05j . Alfonsi, Fruth and 
Schied introduced a generalization of this model for general order book shapes and 
gave an explicit solution for the optimal trading strategy with respect to their mar- 
ket model (introduced in [AFS09| and revisited in |AS09j ): this model is the one 
we will test in a microscopic market environment, and we refer to it as the AFS 
model. 

The AFS model describes the underlying market by two parameters: The shape 
of the (continuous) LOB given by a shape function f and a positive constant p 
expressing the resilience speed of the order book. There are two versions of the 
model: In the first one, the consumed volume recovers exponentially fast; in the 
second version, the best price recovers in this way. The shape of the order book is 
static such that there is a bijection between the impact on the best price and on 
the volume. Thus, the response of the order book to the execution of a large order 
depends on the current price impact only, but not on possible executions before. 

To test the optimal AFS strategies, we need to select a microscopic market 
model. The model that serves best as virtual market environment was introduced 
by Bovier, Cerny and Hryniv and is called the Opinion Game BCH06 . It simulates 
a family of traders on the level of a generalized order book. The underlying idea of 
the generalized order book is that every trader has an individual, subjective opinion 
about the current fair price. Instead of orders, the generalized order book records 
these opinions. Thus, it also captures traders who are willing to trade for a price 
close to the best quotes but have not placed public orders (in some markets it is also 
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possible to place hidden or partially visible orders |FS09| IBPVOQj ) . These traders 
offer hidden liquidity; they will influence the price impact when an order is executed 
but do not appear in the order book |WR05) . Thus, the Opinion Game provides a 
more realistic market response to orders than classical order book models. 

In order to apply the AFS strategies in the Opinion Game, we have to determine 
the correct values for / and p. There are several problems to find the value for p. 
First, the AFS model does not assume a permanent impact; second, the market 
recovery is only poorly approximated by an exponential function; third, p does not 
exist as a constant value but depends on the traded volume. While the first two 
items can be bypassed, the third item strongly confiicts with the assumptions of the 
AFS model. For this reason we introduce a generalization of the AFS model that 
we call the generalized AFS model or GAFS model. The GAFS model substitutes 
p by p that is a function of an order's price impact or volume impact, depending 
on the model version. Furthermore, we extend the results of the AFS model by 
proving that there exists a unique, deterministic optimal trading strategy for the 
GAFS model. It turns out that, although p is a function, the optimal strategy 
evaluates it for one value only. Consequently, the optimal strategies of the AFS 
and the GAFS models coincide when p is chosen to be this value. In this sense, the 
AFS model is also sufficient for the order impact dependent case, but the GAFS 
model is needed to calibrate it correctly. 

After calibrating the (G)AFS model to the Opinion Game, we calculate the op- 
timal strategies for several parameter sets, apply these strategies to the Opinion 
Game, and sample their impact costs. On a general level, the sampled costs show 
the expected natural behavior; for instance, the costs decrease if the available trad- 
ing time T or the number of trading opportunities within [0,T] become larger. 
Furthermore, the simulations reinforce the advantages of the GAFS model com- 
pared to the AFS model. We show that the AFS model performs worse than the 
GAFS model for a bad, yet reasonable, choice of the value for p. On the other hand, 
we find that, in comparison to the predicted costs, the sampled costs of the GAFS 
strategies are up to four times higher. This shows that the (G)AFS model does not 
capture all relevant details of the Opinion Game's order book dynamics, indicating 
that the optimal (G)AFS strategies could also perform worse than theoretically 
expected on real markets. 

In Section [21 we introduce the AFS model and restate its optimal trading strate- 
gies. In Section [31 we present this version of the Opinion Game that we used to 
analyze the AFS model. In Section [31 we determine / and p in the Opinion Game, 
which leads to the GAFS model. Finally, in Section [5l we apply the GAFS optimal 
strategies in the Opinion Game, and compare the resulting costs for several param- 
eter sets. Furthermore, we show that the GAFS strategies perform better than the 
AFS strategies with an suboptimal choice of p in the Opinion Game. 

2. The market model of Alfonsi, Fruth and Schied and its optimal 

execution strategies 

A trader would like to purchase Xq > shares within a time period [0, T], T > 0. 
Xq is assumed to be large such that the trader's order has an impact on the price 
and the underlying limit order book. We will refer to this trader as large trader 
in the following. Because we consider a buy order, we first define how the upper 
part of the LOB, which contains the sell limit orders, is modeled. As long as the 
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Figure 1. The order book of the AFS model. For shuphcity, we 
have left off the time index t. 



large trader does not take action, the LOB is described by the unaffected best ask 
price A° := {A°)t>o and by a shape function / : R — (0,oo) (see Figured]). A° 
is a martingale on a given filtered probability space (fi, {^t)t>OT^,P) satisfying 
Aq = Aq for some Ao £ M; / is a continuous function. The amount of shares 
available for a price A^ + x, x > 0, at time t is then given by f{x)dx. Notice that 
the shape of the order book with respect to the best ask price is static. 

Now, assume the large trader acts for the first time and purchases xq shares at 
time ^o; he or she consumes all shares between A^^ and A^^ 
uniquely determined by 



Dto+ being 



(2.1) 



^'0 + 



f{x)dx = xo- 



:= {D^)t>Q is called the extra spread caused by the large trader. In general, if 



we know 



for a trading time ^ is given by 



(2.2) 



f{x)dx = x„ 



whereby a;„ is the amount of shares traded at time t„. The large trader is inactive 
between two trading times, t„ and and the extra spread recovers. For the 

exact way of recovery there are two versions considered. To conform to the notation 
of |AFS09) ■ we first state Version 2. In this case, Df^ is defined for t E (in, t„+i] by 



(2.3) 



The parameter p is a positive constant called the resilience speed. To complete the 
{At)t>Q by 



definition, we set Z?^ := for t < to- Now, we can introduce the best ask price 



A 
(2.4) 



A, 



In contrast to A includes the large trader's impact. In particular, the amount 
of shares available for a price A^ + x at time t is given by 



(2.5) 



f{x)dx for x>At-A° 
otherwise 



In other words, every trader in the market experiences the large trader's impact 
after time to. 
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The price impact can also be expressed in terms of the impact on the volume 
:— {Ef-)t>Q. Because the shape function / is strictly positive, there is a one- 
to-one relation between E"^ and D^. Given D"^, the process E"^ is defined by 

(2.6) Ef / ' fix)dx. 

Jo 

We can generally introduce the antiderivative of /, 

(2.7) F{x) / f{x)dx, 

Jo 

to get the relations 

(2.8) Ef = F{Df) and Df ^ F-^Ef). 
By ()2.2|) and ()2.8|) . we easily conclude 



(2-9) K+=Et 



This motivates to define Version 1, in which we first define E^ and then derive 
by relation (g^. We set Ef" := for t G [0,to] and 

(2.10) Ef := e-P^'-'-^Ef^^, t e (t„,i„+i]. 

The equations (|2.9p and (|2.10|) define E''^ completely. 

Summarizing, we have introduced two versions of the AFS model: In Version 
1, we define the volume impact E"^ and assume that it recovers exponentially fast 
between the large trader's orders. is then derived from E^ by relation 1)2.8^ : in 
Version 2, we first define the price impact D"^, assume an exponentially fast recovery 
and derive E^ from it. Observe that the AFS model recovers completely as the time 
tends to infinity (and if no more large orders are executed after some finite time); 
there is no permanent impact. Furthermore, the assumption of an exponential decay 
of the price impact is under discussion in the scientific community. An empirical 
study in IBGPWdl] suggests a power-law decay. On a theoretic level, Gatheral 
proved for a market model similar to the AFS model that an exponential decay 
can easily imply arbitrage opportunities while power-law decays do not show this 
undesired property |Gat09j . Alfonsi and Schied, however, were able to show in 
[AS 09) that, despite of the similarity to Gatheral's model, the AFS model does not 
give arbitrage opportunities (under mild assumptions concerning the shape of the 
order book). The final answer to the question how the decay of the price impact 
is modeled best has not been given yet. As far as we know, the same question for 
the volume impact has not been treated. 

We cannot exclude a priori that it is reasonable to sell shares and to buy them 
back later. Thus, we also have to model the impact of (large) sell orders on the 
LOB. Such orders will be written as orders with negative sign. Let B'^ — {Bf)t>o 
be the unaffected best bid price with 

(2.11) B° < Al for alH > 

as only constraint for its dynamics. The lower part of the LOB is modeled by the 
shape function / on the negative part of its domain. More precisely, the number 
of bids for the price Bf + x, x < 0, is given by f{x)dx. As before, we can now 
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introduce the extra spread D := {Df)t>o. Given a sell order < 0, a trading 



time tn , and , Df , is implicitly defined by 



(2.12) / f{x)dx = Xn 



Note that is non-positive. We equivalently define the impact on the volume 
EB := [E^)t>o by 

(2.13) El^:=E^^+Xn. 

E^ is also non-positive, and its connection to is again given by p.Sp . To 
complete the definitions for sell orders, we set Df := and E^ := for all t <to, 
and 

( E^ e-P'-*-*"^Ef^^ for Version 1 

(2.14) <^ " for t e (t„,t„+i], 
[ L'f := e-P^*-*"'>Df^^ for Version 2 

whereby t„ and tn+i are two successive trading times of the large trader. 

Now that all orders are well defined, we introduce the cost of a large order Xt^ 
at some trading time t„ by 
(2.15) 

/^l"^(Aj^ + x)f{x)dx for a buy market order xt„ > 



J^j|"+(i?°^ + x)f{x)dx for a sell market order Xt^ < 



We assume that the large trader needs to purchase the shares in -I- 1 steps 
at equidistant points in time =: to < ■■■ < ■— T. His or her admissible 
strategies are sequences ^ = (^qj • ■ • j C-/v) of random variables such that 

• ^„ is -measurable for all n, and 

• all are bounded from below. 

We denote the set of all admissible strategies by 5. The goal is to find an admissible 
strategy ^* that minimizes the average cost '^{C) given by the sum of the single 
trades' costs: 



(2.16) 



Vri=0 / 



Under the technical assumption that 

(2.17) lim F{X) = oo and lim F{x) = -oo, 

Alfonsi, Fruth and Schied give the unique optimal strategies for both versions ex- 
plicitly. We restate them here to give the reader the opportunity to compare them 
to our theorems for the GAFS model in Section 21 For the sake of convenience, we 
set r -.^T/iN +l)^tn+i-tn. 
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Optimal strategy for Version 1, Theorem 4-1 in |AFS09| . Suppose that the function 
(2.18) := F-i(x) - e-P^F-\e-'"'x) 

is one-to-one. Then there exists a unique optimal strategy ^^^^ = (Co^\ • ■ • t^n^)- 
The initial market order ^q^'' is the unique solution of the equation 



(2.19) i^Xo-N£,^^>{l-e 
the intermediate orders are given by 

(2.20) ei'^ = ... = 4i^^=er(l-e-n, 
and the final order is determined by 

(2.21) 41)^X0-5:^). 

n=0 

In particular, the optimal strategy is deterministic. Moreover, it consists only of 
nontrivial buy orders, that is ^„ > for all n. 

Optimal strategy for Version 2, Theorem 5. 1 in |AFS09I . Suppose that the function 

, / N f{x) - e-^P^ fie-P^x) 
2.22 h2ix) -.^ x^-4rk 77 r 

^ ' ^ ' f{x)-e-P-f{e-P-x) 

is one-to-one and that the shape function satisfies 

(2.23) lim x^ inf f{y) = 00. 

Then there exists a unique optimal strategy ^^^^ — (^q^-' , . . . , ^^^). The initial 
market order is the unique solution of the equation 

(2.24) F-^ (Xo - iVKf - Fie-P^F-^^^,'^))]) = h{F-\^i'^)), 
the intermediate orders are given by 

(2.25) = ■ • • = 4'-i = - F{e-P^F-\^l,'^)), 
and the final order is determined by 

Af-l 

(2) = Y„ _ ^(2) 



(2.26) 4'' = xo - ^ e 



n=0 

In particular, the optimal strategy is deterministic. Moreover, it consists only of 
nontrivial buy orders, that is ^„ > for all n. 

One can easily check that the orders ^ . . . , 4-i have exactly the volume that 
has recovered since the last trade. In this sense, the theorems just give the right 
balance between the first and the last order. This balance is found by solving the 
particular equations, (|2.19p and (|2.24l) . given in both theorems. 
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3. The Opinion Game 

Next, we focus on the Opinion Game. In Section [3.H we recap itulate the original 
model as introduced by Bovier, Cerny and Hryniv in (BCHOG) . We have already 
discussed in the introduction why the underlying generalized order book of this 
model provides even more information about the market behavior than a classical 
order book. Yet, the Opinion Game has no explicit notion of orders and, conse- 
quently, also large orders and their executions are not defined. However, we argue 
in Section 13.21 that the generalized order book contains an implicit notion of or- 
ders. Furthermore, we state the algorithm that we use to simulate the execution of 
large orders and show on a qualitative level that this extension leads to a realistic 
response of the Opinion Game to large orders. 

3.1. The model. We consider a fixed number of traders N G N and a fixed number 
of tradable shares M < N. Every trader is described by the pair (p^, n^), whereby pi 
is the opinion of trader i about the right logarithmic price; the opinion is individual 
and subjective. For numerical reasons, pi G Z. The number of shares that trader i 
posseses is given by Ui. In the most general setting, Ui can take values form to 
M; however, we just divide traders in buyers and sellers by setting Ui G {0, 1}. We 
define the best bid price by 

(3.1) p^ :— max pi, 

i-.iii —0 

and the best ask price by 

(3.2) p"- := min pi] 

i:7li — l 

the price p is given by 

(3.3) p:= . 

The market is said to be in a stable state if p^ < ; no buyer is then willing to pay 
the lowest asked price and vice versa. 

For numerical reasons, the dynamics is defined in discrete time. Every round 
consists of three steps: 

(1) A trader is chosen 

We define 

a A-) n(i A — / +P^i^) if trader i is buyer 

yc.'i) gyi, i) . | ^ _ p''{t))-'^ if trader i is seller ' 

and set 

(3.5) P(trader i is chosen at time t) := — .f^ ' ^ . 

Ef=i5(j,i) 

The parameter 7 > can be chosen arbitrarily. Observe that the defined 
measure prefers traders close to the price. The larger 7 is the greater is this 
preference. Here, we assume that a trader close to the current price reacts 
faster to price fluctuations than a long time investor with an opinion being 
completely different from the current price. 

(2) The trader's change of opinion 

If a trader is chosen, he or she changes her opinion iop[{t+l) := pi{t)+d{t). 
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The random variable d{t) takes values in {—I, — I + 1, ... ,1 — 1,1}, I £ N, 
and is independently sampled for all t. The measure of d{t) is given by 

r 2ITT ^ 1) form 7^0 

(3.6) P{d{t) =m) = I , whereby 

I 1-ELiW) = ±"^) else 

, J hb if trader i is a buyer 

^ ' ^ ^' ' \^ fj,s ii trader j is a seller 

We assume that /^s < 1 < Mb to implement the idea that all traders have a 
tendency to move into the direction of the price. The ficxt{t) introduces a 
drift that changes randomly in time and acts on all traders in the same way, 
modeling news, rumors and events influencing the price. This drift process 
is of paramount importance for the stylized facts, statistical features of the 
price process on large time scales; however, as we want to concentrate on 
the large orders' impact, which happens on shorter time scales, we assume 
/^cxt = 1 in the remainder of this article. 
(3) Trading (if necessary) 

If the market with the changed opinion is stable again, that is 

(3.8) p^ipiit), . . . ,p'i{t), . . . ,PNm < p"((pi(i), • • • ,Pi{t), ■ ■ ■ ,PNm, 

weset Pi{t+1) := p^(t + l), else a trade happens. Let us assume that trader 
i is a buyer, the other case is symmetric. We uniformly choose a trading 
partner j with pj{t) = p'^'{t) and set ni{t + 1) =0 and nj{t + 1) = 1. After 
the trade, both traders move away from the best price: 

(3.9) pi(t+l) :=p"(i + l)+5 and pj{t + 1) := p"{t + 1) - g 

whereby g and g can be fixed or random numbers in N. This last step 
is justified by the idea that the traders want to make profit and are only 
willing to trade for a better price than they have paid. 

3.2. An extension for large orders. For the existence of orders in the Opinion 

Game, let us consider a buyer and a seller with matching opinions such that a 
trade happens. In order book driven markets, trades can only come about if both 
traders have placed some kind of orders. Prom this point of view, the Opinion 
Game has an implicit notion of orders, at least when trades are happening. This 
observation motivates a change of our point of view on the Opinion Game: In the 
remainder of this article, we rather think about (maybe hidden or unplaced) buy 
or sell orders instead of traders with opinion. For the sake of convenience, we omit 
the word generalized in the following when we talk about the order book of the 
Opinion Game. 

To test the AFS model, we have to introduce large orders to the Opinion Game. 
Assume we would like to purchase X stocks at time t. Then, we do not apply the 
standard dynamics explained above at time t; instead, we use the following algo- 
rithm: 

set p]^^ := pk{t) for all e {1, . . . , N} 
set := nk{t) for all fc e {1, . . . , N) 

let p"(l) be the best ask price of the configuration (Pfe^^'^i^^)^ ^ ^ 
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from a; := 1 to X do { 

find i s.th. p'f^ < p'-f^ for all j G {1, . . . , iV} 



choose uniformly trading partner j s.th. i ^ j and p^^'' = p°'{x) 
= 1 and nf'^^'' := 
= 2?'^ (a;) - .9 
= p'^{x) + g{x) 



(x+l) 
(x+1) 



(x+l) 

Pi 



set pi^+^'^ := p[^+^'> for aU fc e {1, . . . , N}\{i,j} 

set 4"+'^ := 4"+') for ah fc G {1, . . . , N}\{iJ} 

let be the best ask price of the configuration (p'f^^\ n['^~^^^] 

V / ie{i,...,-/v} 

} 

set pk{t + 1) := p^^+'^ for ah fc G {1, . . . , N}\{iJ} 
set nk{t + l) k G {1, . . . , 7V}\{i, j} 

The value g is the same random or deterministic value as in the original dynamics. 
The random variables g{x) are independently distributed with measure 

1 ^ 

(3.10) P{9{x) = k) = -Y. l{p<^'-p"(.)=.} e No. 

n=l 

In other words, we execute a large buy order of volume X by taking the lowest 
X orders one by one and putting them directly to the ask price such that a trade 
is enforced. The number of market participants is constant in the Opinion Game, 
thus taking orders from the tail is an obvious method to simulate a large order that 
is placed out of the blue. After each single trade, we adjust the order prices; the 
price of the (new) buy order is decreased by g, the price of the sell order is increased 
by g. The density function of g is given by the order book's current shape. 

This choice of g leads to a realistic response of the order book to the execution 
of large orders (see Figure While the large order is executed, the new sell orders 
have a great probability to be placed in vicinity to the peak of the order book's 
seller part; thus the peak grows, and the order book provides more liquidity for 
prices in this region. Here, we implement the idea that the execution of a large buy 
order leads to a conspicuous rise in the price that attracts more traders to place sell 
orders close to the current best ask price; these traders hope that the price increase 
continues such that their orders are executed. At the same time, these additional 
offers provide more liquidity that slows down the price increase. If we consider 
the immediate price impact of the large order as function of the executed volume, 
the additional liquidity leads to a sublinear function shape. Sublinear behavior of 
an order's immediate price impact has also been observed for real world markets 
in several empirical studies |BGPWd4l IATHL05] . After the execution of the large 
order, the price increase stops and some traders realize quickly that orders for higher 
prices will probably not be executed in the near future; they place new orders for 
lower prices. However, most traders need more time to acknowledge that their price 
claims are probably too high. In result, the best ask price decreases, but the order 
book volume in proximity to the new best quote is low. It takes more time until the 
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Figure 2. Sketch of the order book shape in the Opinion Game 
when a large order is executed. Before the execution, the order 
book is in equihbrium (upper left figure); directly afterwards, the 
best ask price is increased, and there is more liquidity close to it 
(upper right figure). When the LOB recovers from the order, the 
best ask price decreases, but the best quotes have a low volume 
only (lower figure); it takes more time until the order book is in 
equilibrium again. 

LOB is back in equilibrium. This recovery behavior of the order book is technically 
implemented by the preference for traders close to the best quotes in (|3.5p when 
we update opinions. As another feature that is known from real world markets, 
the best ask price does not return to the value it has had before the execution, but 
it stabilizes at higher values after the order book has returned to equilibrium. We 
discuss this permanent impact on the best price in Section 14.21 

Since the dynamics are symmetric, the algorithm applies to large sell orders in 
the same way. 



The Opinion Game provides a variety of parameters to influence the character- 
istics of the modeled market. For instance, it is possible to change the size of the 
market or the volatility in the Opinion Game to simulate different markets. Never- 
theless, we restrict ourselves in the following to one parameter set, which is stated 
in Subsection 14.11 Although the variation of parameters surely leads to additional 
insight, our choice already gives a sound understanding of the problems that occur 
when applying the AFS model. In the same subsection, we also describe the aver- 
aged shape of the Opinion Game's order book that will serve as shape function / 
for the AFS model. 

Having set up the Opinion Game, we try to determine the AFS model's resilience 
speed, p. It turns out that the assumption of a constant p is not valid in the Opinion 
Game. Thus, we substitute p by a function p that maps both the order's impact and 
the time elapsed since the last trade to the resilience speed. We describe how we 
can extract the function values from the sampled data, and argue that it is sufficient 
to know the impact-dependent function p{-) := p{-,t) only; recall that t = T/N 
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was the recovery time between two successive trades. Finally, we introduce the 
generalized AFS theorems that assume the resilience speed to be a function of the 
price impact (in Version 2) or the volume impact (in Version 1). 



4.1. The parameters of the Opinion Game and the shape of its order 

book. There is a high degree of freedom in the parameters for the Opinion Game. 
Nevertheless, certain parameter sets have been shown to be more reasonable choices 
than others. Calibrated with these parameter values, the Opinion Game results in 
a realistic price process in terms of stylized facts. However, not all choices can be 
justified rigorously. For an extensive discussion about the choice of parameter 7, 
for instance, we refer to (Wei09bj . We used the following values in all simulations 
throughout this article, since thos e ones ha ve been shown to generate price processes 
with realistic statistical features BCH06I IWeiOQa) : 



t) of traders N 


2000 


tt of shares M 


1000 


speed of adaption 7 


1.5 


jump range {— /, ...,/} 


{-4,. ..,4} 


drift of buyers fi b 


gO.l 


drift of sellers jis 


g-0.1 


jump ranges g, g 


random variables, uniformly distributed on {5, . . . , 20}, 
sampled idependently every time they are used 



All sample runs that we did in the Opinion Game, either to extract necessary pa- 
rameters or to test execution strategies, were started independently with a random 
seed for the random number generator. Furthermore, the recording of data or the 
execution of large orders was started after 1 000 000 simulation steps only, such that 
the model had sufficient time to get close to a stable state. 

To determine /, we recorded 500 times the Opinion Game's LOB relative to the 
best prices. Figure [3] shows the resulting upper part of the order book. The lower 
part is symmetric up to small deviations caused by the object's random nature. 
Even if the shape is not static as assumed in the AFS model, an averaged shape 
is clearly visible. We use these mean values to define the shape function / for 
the Opinion Game. For non-integer values, we interpolate / by assuming that 
the function is a right-continuous step function. This means that we violate the 
assumption of the AFS model about / being continuous. Yet, this choice for / has 
the advantage that the integral of / from to an integer n is equal to the sum of 
the integer function values from to n — 1. Furthermore, for all parameter sets that 
we considered, we were still able to find unique solutions for the optimal trading 
strategies. 

Recall that the price scale in the Opinion Game is logarithmic, whereas the AFS 
model assumes a linear scale. However, it is possible to scale the grid of the Opinion 
Game with a factor e, and the difference between logarithmic and linear scale is 
negligible if e is small. To determine the order of e, we consider an order of 200 
units of shares, 20% of the market volume in the Opinion Game; it is mentioned 
in |AFS09| that the size of large orders can amount up to twenty percent of the 
daily traded volume. We assume that the shape of the LOB, /, is determined as 
described above, and the best ask price before our trade is denoted by . Then 
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Figure 3. The seller part of the LOB relative to the best ask price. 
The solid hne marks the mean values, the dashed lines illustrate 
the quartiles. The minimal and maximal values are illustrated by 
the dotted lines. 

the relative impact costs are given by 



Ri2039.47 

An empirical study of the US stock market shows that large orders can cause 
relative costs up to 3.55% |ATHL05] . If we assume that e < 0.0355/10.2, then e is 
of order 10"'^ at most. Thus, it is reasonable to assume e to be small. However, we 
are interested in qualitative results; thus, and for the sake of convenince, we will 
simply assume that the Opinion Game operates on Z. 

4.2. Determining p for the AFS model. In the following, we present our ap- 
proach to calibrate p for the Opinion Game. We describe our simulation approach 
and the corresponding results for Version 2 of the AFS model only. Recall that, in 
this version, p determines the recovery speed of the price impact. Our ansatz and 
the observations are qualitatively the same for the other version. Nevertheless, we 
introduce the GAFS model for the price impact dependent as well as for the volume 
impact dependent case in the end of this section. We first describe how we sampled 
the necessary data. Afterwards, we focus on the main problems of extracting p from 
those data. Possible solutions are discussed and culminate in this section's main 
result: The GAFS theorems, which assume that the resilience speed is a function 
p depending on the order's impact. 



(4.1) 
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We fixed a price impact D G {!,..., 20} and ran 2500 simulations for each value 
of D, resulting in 50 000 simulations. Since every run had an initialization period 
of 1 000 000 steps, each simulation took several seconds. Observe that a simulation 
time of one second per run already results in a total computing time of almost 
14 hours. As we ran several simulations parallel, we were able to finish the data 
collecting within a few days. 

Each run consisted of a trading part in which a large sell order was executed at 
once. The particular order volume was determined by its price impact: The trading 
part was finished as soon as the impact was equal to D. In a second experiment's 
part, we recorded the relaxiation of the price. In particular, the large execution 
took place at time i := \ 000 000; we recorded 

(4.2) p{t):=p''{t + l + t)-p'^{l] 

for t e {0, . . . , 50 000}. The process (p(t))teNo is the discrete counterpart of the 
AFS model's process D^. 

To avoid problems caused by random fluctuations in p, we consider the pointwise 
average of the samples denoted by {p) and defined by 

2500 
i=0 

for all t G {0, . . . , 50 000}, p^ denoting the ith sample. For a clear distinction, we 
denote the value for p that we extract from (p) by Pnum- The AFS model assumes 
(p) to be of the form 

(4.4) = De-P-^-* 

with a static value PnvL-m] this follows from equation (12. 3p . Thus we should be able 
to determine Pnum by 

(A K\ - ln£'-ln(p)t 

(4.5) Pnum = ^ 

for an arbitrary t. However, the right hand side of the equation depends on D and 
t; thus, we would like to consider Pnum(^, t) as a function. 

Given (p), let p : [0, oo) E the corresponding regression function of the form 

(4.6) pt:^A + BeP\ 

for t G [0, oo). It is determined by a Newton-GauB algorithm with three degrees of 
freedom: A, B, p. Observe that all three values can depend on D. The form of 
the regression function is motivated by assumption (|4.4I) . which also leads to the 
expectation that A — and B — D. Figure |4] shows the statistical behavior of p 
for D — 8, the corresponding (p) and p. Furthermore, we compare (p) for different 
D values. The three main problems are visible: 

(1) The AFS model assumes Ad to be 0; this is not the case. 

(2) The measured data is only well- approximated by an exponential function for 
large times. For small t, it is doubtful that the assumption of an exponential 
decay is the right choice at all. 

(3) If /Onum was constant the (p) should be approximately parallel on a loga- 
rithmic scale; instead, Pnum depends D. 

These problems occured for all tested values of D. Next, we discuss the problems 
and their consequences for the determination of Pnum one by one. 
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5000 10000 15000 20000 



Figure 4. The two upper graphs show quartiles and extremal val- 
ues of 2500 samples of p tor D — 8, and the corresponding (p) and 
•p (red). The graph on top illustrates the long time behavior on the 
domain i G [0, 50 000]. Clearly, p converges to a level > 0. The 
middle graph displays t e [0, 2000] showing the poor approximation 
by p. The lower graph shows (p) (black) forZ3 = 16, D = 12 and 
D — 8 (top down) as well as their regression functions p (red) on 
a logarithmic scale and with respect to the new asymptotic levels 
Ad . If Pnum was constant the {p) should be approximately parallel. 
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Figure 5. Mean, quartiles and extremal values of 500 samples 
of the permanent impact in dependence on the purchased volume 
V £ {25, 50, ... , 275, 300}. For every volume V, we recorded the 
best ask price before the trade and the averaged best ask price 
500 000 steps after the trade. Here, the averaged best ask price 
is the mean of the best ask price sampled all 100 steps over a 
time interval of 100 000 steps. The linear regression of the mean is 
displayed in red. 

4.2.1. Existence of a permanent price impact. The reason for problem (1) is a per- 
mament impact on the order book that a large trade causes. After having recovered, 
the LOB is shifted by Ipcr{X), whereby /per : M — M is assumed to be increasing 
and /por(O) = 0. Huberman and Stanzl |HS04) argued on a theoretic level that 
linearity of /per is equivalent to the absence of arbitrage opportunities. Empirical 
studies by Almgren et al. [ATHLOS] reinforce the conjecture of a linear perma- 
nent impact: The authors state that the permanent impact is well described by 
the power law x''^-^^'^-^ with respect to a Gaussian error model; the assumption of 
linearity cannot be rejected by this result. Figure [5] shows the permanent impact 
for the Opinion Game. The mean is well aproximated by a linear function with 
coefficient 0.02738. 

Concerning the problems in determining Pnum, caused by the positive Aj^, we 
have two possibilities: First, we could ignore the permanent impact such that Pnum 
would be given by (j4.5p . This would be an appropriate solution for small t, but it 
would cause the AFS model to assume that even for large t the LOB is still not 
close to equilibrium; Pnum could become arbitrarily small. Second, we could assume 
that the whole model has been shifted by Ad such that Ad is the new zero line. In 
this case, pnum would be given by 



(4.7) 



Pnum{D,t) 



lni?-ln((p)t - Ad) 



t 
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which is fine for large t but grows to infinity as t goes to zero. To avoid this problem, 
we define 

(4.8) Pnum[D,t) -.^ . 

Furthermore, let us point out that there is no special reason to choose 1 — exp(— t). 
However, at this point, it becomes clear that the complex dynamics within the LOB 
are poorly described by an added permanent impact function. 

4.2.2. (p) is poorly approximated by an exponential function. Since (p) should decay 
exponentially fast, pnum should be a constant. However, the existence of a perma- 
nent impact and the consequential definition of Pnum hr (|4.8p makes the validity of 
this assumption unlikely here. Yet, even without the permanent impact, the de- 
scription of (p) by an exponential function is poor as the upper right graph of Figure 
m shows. As mentioned in Section [21 the rejection of an exponential decay does not 
contradict former research results. If we nevertheless try to calibrate p, it becomes 
time-dependent. A time-dependent resilience speed seems to be incompatible with 
the AFS theorems at first, but a closer look at the theorem's statement reveals that 
p is only needed to determine the order book state before the next trade, given the 
state after the current trade. The time between two succeeding trades is given by 
T. Thus, we focus on Pnum(-,T) and use the notation 

(4.9) P„um(C) :=P„um(i?,r) 

assuming that r, which is given by the input parameters N and T, is fixed. Figure 
ini shows the function /Onum(', ■'') for several values of r. 

4.2.3. /Onum is a function of D. In contrast to the time dependence, the dependence 
on the order's price impact requires a generalization of the AFS theorem, stated in 
Section [2j Now, the resilience speed p : M. (0, oo) is a continously diffcrentiable 
function of D^. In particular, the equations (|2.3p and (|2.14p . which describe the 
price recovery in the AFS model, change to 

(4.10) Df e-P« + )(*-*.X+ for t G (i„,i„+i], 

(4.11) Df e-P« + )(*-*"X+ for t e (t„,t„+i]. 

We denote this modified model as Version 2 of the generalized AFS model. 

For the following theorem concerning the optimal trading strategy for the GAFS 
model, we need two technical assumptions: 

(4.12) The range of p is a subset of [fc, if], < fc < i^T < oo, and 

(4.13) 1 - Tp'{x)x > for aU x e M. 

The first assumption bounds the relaxation speed, the second assumption ensures 
that a larger impact cannot overtake a smaller one in the recovery phase as we will 
see in Lemma [A. II 

Theorem 4.1 (Optimal stratey for the generalized AFS model. Version 2). Suppose 
that p fulfils ^J^T^ and ^.13^ , and that f satisfies 

(4.14) lim inf f{y) = oo. 

|a;|— >oo y^le^Pi^^x/x] 
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0.0006 r 




Figure 6. We show the graphs of pnum{D,T) in dependence on 
D for r = 70, 700, 7000 (top down). Observe that the x-axis only 
begin in 5 due to the fact that small price impacts cannot be dis- 
tinguished from the noise contained in the signal. 
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Furthermore, let the function 

(A 15) h (x) •= - e-^-P(-^f{e--p(-)x){l - Tp'{x)x) 

be one-to-one. Then there exists a unique optimal strategy — (^q^\ . . . ^ 
S. The initial market order (^^^ is the unique solution of the equation 

(4.16) F-^ [Xo N - F (e--(^-^(«^^'))F-i(^(^'))]) = /^^(^-^(ef )), 
the intermediate orders are given by 

(4.17) = . . . = d'), = e^^' - F (e---(--^(«^"))F-(e^^))) , 
and the final order is determined by 

N 

(4.18) 4^)^xo-5:d^). 

In particular, the optimal stratey is deterministic. Moreover, it consists only of 
nontrivial buy orders, that is Qi > Q for all n. 

Proof See Appendix IA.2I □ 

Observe that the intermediate orders of the optimal strategy, defined in (|4.17l) . 
have the same size. Furthermore, they suggest to purchase exactly that volume 
that has recovered since the last trade. The GAFS model has inherited this feature 
from the AFS model. Yet, this observation means that also the Df^^ are equal 
to each other for all n £ {0, . . . , — 1}, and thus, p is only evaluated for one 
value. In other words, although p is a function, the optimal strategy uses only one 
value. Of course, ii p = p for some constant p in the GAFS model both models, the 
GAFS and the AFS, coincide. This is the main advantage of the GAFS theorem: 
It determines the right resilience speed from p; a manual calibration, as in the AFS 
model, is not needed anymore. 

As already mentioned, our simulations for the calibration of p in Version 1 of the 
AFS model result in the same problems as described for Version 2. Especially, p 
becomes volume impact dependent, motivating the GAFS model. Version 1: Now, 
the resilience speed p : [0, oo) — (0, oo) is a twice differentiable function of E^. In 
particular, the equations (|2.10p and (|2.14p from the AFS model become 

(4.19) Ef := e-'^« + )(*-*")<+, t e (t„,t„+i], 

(4.20) i?f e-P« + )(*-*")ijf^+, t g (i„,t„+i]. 

in the GAFS model. Then, the following theorem determines the optimal trading 
strategy in the set of all admissible strategies S: 

Theorem 4.2 (Optimal stratey for the generalized AFS model. Version 1). Suppose 
that p fulfils the assumptions ^-IS^ and (^77^, and additionally 

(4.21) e^K^)^ (1 _ Tp{x)x) < 1 for all x e M. 
Furthermore, let the function 

F-^{x) - e-f^''^^ (1 - Tp'{x)x) i^-i(e~P(^)^x) 



(4.22) hi{x) := 



1 - e-'^(^)-^ (1 - Tp'{x)x) 
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N 


T 


?o 


(91 

^(2) 


SAT 


Predicted 


Sampled 


Samp/Pred 


40 


400 


8.95 


4.74 


6.38 


701.47 


1867.74 


266% 


40 


4000 


6.13 


4.81 


6.15 


500.24 


1573.50 


315% 


40 


40 000 


5.16 


4.86 


5.40 


392.42 


1076.89 


274% 


50 


400 


8.29 


3.80 


5.29 


691.94 


1853.37 


268% 


50 


4000 


5.20 


3.88 


4.94 


462.51 


1535.96 


332% 


50 


40 000 


4.26 


3.90 


4.82 


349.26 


1014.42 


290% 


80 


400 


7.55 


2.37 


5.63 


691.65 


1832.69 


265% 


80 


4000 


3.73 


2.44 


3.37 


387.98 


1464.03 


377% 


80 


40 000 


2.65 


2.46 


2.91 


231.67 


914.17 


395% 



Table 1. The optimal strategies according to the GAFS model, 
Version 2, for X — 200 and several values for N and T. 



he one-to-one. Then there exists a unique optimal strategy ^^^^ — ■ ■ ■ S 

S. The initial market order is the unique solution of the equation 

(4.23) (Xo - - e-P^i<>')r)^ ^ /,,(^W), 
the intermediate orders are given by 

(4.24) e(^' = ---=d^=?r(l-e-'^«^")-), 
and the final order is determined by 

N 

(4.25) 41)^X0-5:^^. 

n=0 

In particular, the optimal stratey is deterministic. Moreover, it consists only of 
nontrivial buy orders, that is ^„ > for all n. 

Proof. See Appendix lA.ll □ 

As in Version 2 of the GAFS model, p is only evaluated in one value, and ii p = p 
the best strategies of the GAFS and the AFS models coincide. 

5. Numerical results 

Let us turn to the numerical results of this paper. Again, we focus on Version 2 
and use the parameter values determined in the last section to calculate the GAFS 
optimal strategies and to apply them in the Opinion Game. We show first that 
the resulting costs show an expected behavior on a general level, and that the AFS 
model with a suboptimal value for p suggests a strategy that produces significantly 
higher costs than the corresponding GAFS strategy. Afterwards, we compare the 
costs sampled in the Opinion Game to the costs predicted by the GAFS model, 
and find large difi'erences. We refer to the values for / and p, Pnum, as determined 
in the Sections \^J\ and 14.21 

Table [T] shows the GAFS optimal strategies and their costs for different values 
of T and N. We consider two kinds of costs. The predicted costs are the impact 
costs that are theoretically predicted by the (G)AFS model. Here, we assume that 
the market behaves as described in Section [21 The sampled costs are the average 
of 500 samples with the given strategy in the Opinion Game. Observe first that 
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Strategy 


^(2) 

SO 




^(2) 
SAT 


Predicted 


Sampled 


GAFS 


3.73 


2.44 


3.37 


387.98 


1464.03 


AFS 


21.02 


0.97 


102.26 


979.97 


1584.12 



Table 2. The optimal strategies and their costs for the AFS 
model with p = p and the GAFS model with p from Section 14.21 
{X,T,N) = (200,4000,80). 



the predicted and the sampled costs decrease if the trading time or the number of 
trading opportunities increase. Of course, this is no special feature of the (G)AFS 
strategies; every fixed strategy benefits from a larger r, which is implied by a 
greater T, and additional trading opportunities can be used, but do not have to be 
used. Thus, every reasonable strategy can only perform better with larger T or N. 
Nevertheless, the costs of the GAFS strategies show a reasonable behavior. 

Furthermore, the GAFS strategies perform better than the AFS strategies: Re- 
call that the AFS model with the right value for p results in the same optimal 
strategy as the GAFS model. Moreover, the (G)AFS model assumes an exponen- 
tial decay of the price impact (see (|4.4p ). We have taken this assumption into 
account by introducing (/o)'s regression function p in (j4.6p . which was of the form 

(5.1) pt-.^A + Be'PK 

Table [2] shows the optimal strategies and their costs for {X, T, N) = (200, 4000, 80) 
with respect to the AFS model with p = p and the GAFS model with p = Pnum- 
The example shows that a naive guess of a good p can lead to much higher costs: 
The AFS costs amount 253% of the GAFS costs in prediction, and still 108% in 
the samples. 

The last two paragraphs have shown that the GAFS strategies are reasonable 
and superior to the AFS stratgies. However, returning to Table [U we see that the 
predicted and the sampled costs for the individual parameter sets differ strongly. 
The last column shows both kinds of costs in relation to each other. Obviously, 
the sampled costs are multiple times higher. This observation is a strong evidence 
that the assumptions of the (G)AFS model are insufficient to capture the whole 
complexity of the order book dynamics in the Opinion Game. It is doubtful if the 
(G)AFS model really suggests optimal trading strategies for this artificial market 
environment. With regard to the Opinion Game features concerning the order book 
behavior that we have discussed in Section[31 it is highly unlikely that the (G)AFS 
strategies minimize the costs in real world markets. 

6. Conclusions 

In this paper, we have tried to apply the AFS model to an artificial market 
environment. The elegance of the AFS model, the order book approach and the 
explicit results for the optimal trading strategies, cannot be denied. Yet, the prob- 
lems we faced in calibrating the model to our market pose the question if the AFS 
model assumptions are oversimplified. We point out again that the problems we 
had to handle, the permanent impact and the non-exponential decay of the impact, 
are not artificial. It is well known that those effects are also characteristic for real 
markets. Even if it is possible to bypass some problems or to extend the model in 
a suitable way as we did by introducing the GAFS model, the question remains if 
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a next generation of large order models is necessary. In jGSSlOj . the authors caU 
the large order market models with an underlying order book models of the second 
generation dissociation of (first generation) large order models working with fixed 
price impact functions as described in the introduction. Here, a third generation 
of models is conceivable taking into account that the order book shape is not con- 
stant such that there is no one-to-one correspondence between the price and the 
volume and that the market adapts to periodically executed large orders. Yet, it is 
also obvious those models would be of much higher complexity and analytic results 
would be hard to get; a wide subject for future research. 

Acknowledgement. We thank Anton Bovier (University of Bonn), who sug- 
gested the article's subject to us and supported our research with many remarks, 
and Antje Fruth (QPL Berlin) for the discussions concerning the AFS model. Es- 
pecially, we thank Evangelia Petrou (University of Bonn) , who contributed to the 
article's quality with a countless number of critical comments, suggestions and 
queries. 

Appendix A. Proofs of the Theorems 14JJ and [H 



The structure of the proofs remains the same as in the proofs of the corresponding 
AFS theorems (see Appendices A to C in |AFS09| ). Nevertheless, we need to justify 
the constraints on p; furthermore, the calculations become more complicated by our 
generalization. For simplicity, we assume to — in this section. 

We start with the introduction of slightly changed dynamics for the CAES model 
and the reduction of the admissible strategies to deterministic ones. For any ad- 
missible strategy ^, the new dynamics is defined by the processes D := {Dt)t>o and 
E := {Et)t>o- We set Dq = Dt, := =: Et, = Eq and 

(A.l) Et„+ Et„ + U and A„+ F-\F{EtJ + 

for the trading times t^, . . . ,tiq . The processes' values between two successive trad- 
ing times t G (i„,t„+i) are given by 



(A.2) 



Et := e-''('^'"+)(*-*")£;t„+ for Version 1; 
Dt := e-'^(^'" + )(*-*") A„+ for Version 2. 



Given one process, we can recover the other one by the equations (|2.8p : 

(A.3) Et^F{Dt) and Dt^F-^{Et). 

Lemma A.l. Under assumption ^775|), 

(A.4) E^ <Et< Ef and Df < Dt < Df 

for all t > 0. In the special case that all ^„ are non-negative, we have D^ = D and 
E^ = E. 

Proof. To see that D"^ = D and E"^ — E if £^ consists of buy orders only, observe 
that the new dynamics matches exactly the original ones for such a ^. 

For the general case, we consider Ef < Et; the other inequalities follow equiva- 
lently. Observe that it is sufficient to prove 

(A.5) i?f„+, < Et^^, 

for 

(A.6) Ef^^ < Et^+, 
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since both function are exponentially decreasing on (t„, tn+i], and the relative order 
of and E cannot be reversed from i„ to i„+. Furthermore, we can restrict 
ourselves to the case that Ej^ and i?t„+ have the same sign, as the signs canno 
change in the considered time interval, (tn,tn+i]- We are consequently done if we 
can show that the inequality 

(A.7) \x + y\e-P^''+y^^ > Ixje-'^^")" 

for all (x, y) G with sgn(a; + ?/)=sgn(a;) and |a; + y| > \x\. Observe that we have 
equality in the equation above if we consider the trivial case that y = 0. We define 
a function m^; : R M by 

(A.8) u^{y):^{x + y)e-P^-'+y'^\ 

Differentiation yields 

(A.9) 4(y) = e-P^^+y^^l - tP'{x)x). 

The right hand side of this equation is positive by assumption (|4.13l) . thus Ux is 
strictly increasing. Since Ux (0) = xe-P^''^^ (IXTll is proven. □ 

It remains to define the simplified price of under the new dynamics by 
(A.IO) 7ft„ (e„) := r^"^ {Al + x)f{x)dx = ^o^Cn + /""'"^ xf{x)dx. 

Observe that 

(A.ll) 7ftJ^„) <7rt„(er0 

for all admissible strategies ^ because of Lemma [A. II In particular, if ^ consists of 
buy orders only, we have equality. 

We show in the next two sections that, the strategies given in the Theorems 14.21 
andHH ^(1) and ^^'^\ are the unique minimizers of the price functional 

' N 
.11=0 

for the corresponding version of the model. As ^^^^ and ^'•^^ consist of buy orders 
only, (jA.lip and the remark afterwards imply that these strategies are also the 
minimizers of the original price functional 

We turn to the reduction of S to deterministic strategies. Let us define the 
remaining trading volume X = (A't)(g[o,T] by 

^o-Et„<t^« forf<T 
for i > T ■ 



(A.12) "^(0 E 



(A.13) Xt := 



:= 0. We can transform the price of a strategy ^ G ^ 

by 

N N N Dt^ + 

(A.14) E^*"(^») = E<^" + E / ^fi^)dx, 

n=0 n=0 11=0'' 

and use definition (jA.13[) as well as integration by parts to rewrite the first term on 
the right hand side: 

TV JV N 

(A.15) E = - E < l^^-^+i - ^*") = ^0^0 + E i< - < 



n— n— n— 



1 + 1 , 
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Since ^ is admissible, X is a bounded process and Xt,^ is ^t^ ^-nieasurable, is 
a martingale. Thus, the expectation of (|A.15P must be XqAq. The second term on 
the right hand side of (|A.14I) is deterministic for a given realization of a strategy 
^(w). We denote this term by 



for Version i, i e {1, 2}. Now, we can express by 
(A.17) -^"(C) =^o^o+IE(C«(e))- 

We spend the next two section to show C*-*' has a unique minimizer in the set 
(A.18) S L (xo, . . . ,xjv) e K^+i : ^ a;„ = Xoj 

I n=0 J 

and this minimizer is determined by the formula given in Theorem 14.21 or 14.11 re- 
spectively. 

For the sake of convenience, we introduce some more notation: 
(A.19) CLx := exp(-Tp(x)) for a: e R, 

(A.20) a„ := | " Tf^M for - ^ {0, ... , N}. 

^ ' y exp{-Tp(Dt^+)) m Section lA. 21 ' 

Because the range of p is assumed to be [k, K], < k < K < (x, hy (|4.12l) . 

(A.21) e-^^ < flx < 6-^'= and e-^-^"^' < a„ < 6"^'=. 

Additionally, we will need these functions: 

(A.22) F{x) := xf{x)dx and G{x) -.^ F{F-Hx)). 

Observe that 

(A.23) G'ix) = F'iF-\x))iF-'nx) = F'^ fiF-\x))j^^;^^ = F'^x), 

and thus, G is twice continuously differentiable, non-negative, convex and has a 
fixed point in 0. 

A.l. The optimal strategy for Version 1. In this section, we calculate the 
unique minimizer of C'^-* in S. For any ^ = (a;o, . . . , xn) G S, we have 

(A.24) = / ^/(^)'^^ 

N 

n=0 
N 

= I][G(£;t„+x„)-G(£;tj] 

n=0 

Lemma A. 2. The function C'^-* has at least one local minimum in S. 
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Proof. The statement will follow from 

(A.25) C(i)(0 oo for Halloo ^ oo 

because C'^^ is continuous. First, we use the properties of G to find a lower bound 

for G{x) ~ G{cx), a; G R and c e [0, 1]: 

(A.26) G{x)-G{cx) > G{cx) + {x-cx)G'{cx)~G{cx) 

= (l ~ c)\F-\cx)\\x\. 
The inequality (jA.26[) applied to (|A.24I) leads to a lower bound for C'-^': 

= G ((n^^oa„) H h aAr_ia;Ar_i + xw) - G(0) 

- G (a„ [(njjj'l\,a„) H h a„ja;„_i + a;„]) 

> G ((n,^^oa„) xo H h aN-iXN-i + xn) ~ G(0) 

N-l 

+ [(1 - an) 1^""^ (fln [(n'^~loam) H ha„^x„_i +x„])| 

|a« [(n"j=oa„) xo H h a„ia;„-i + Xr, 

We define a linear mapping T : K^+i ^ M^+i by 

(A. 28) r(^) := (xcfloxo + xi, . . . , [n^jQ^a„] H h aAr-iXAr^i + xat) , 

and the smallest a„ by 

(A.29) a:=min{a„ : {0, ...,iV}}. 

Observe that 

(A.30) ||T(OIL ^ ||(2:o,aa:o + a:^i,...,a"a::o + --- + aa;w-i+a:^Ar)lloo 

for ll^lloo ^> oo as well as G{x) oo and |F~-'-(ax)||a;| oo for \x\ oo. The last 

statement follows, because F is unbounded. Finally, we define 

(A.31) H{x) := min {G{x), \F-\ax)\\x\) . 

Also H{x) — > oo for x oo, and consequently, 

(A.32) > HiWrmU - G(0) ^ cx). 

□ 

One has to determine ^g"'^^ by solving 
(A.33) (Xo - 7Ve^^'(l - ao)) - /ii(?^'^) 

in Theorem 14.21 We define the function 

(A.34) hiix) hi{x) - {Xq ~ N{1 - a^)x) 
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for which ^q^' is a zero. 

Lemma A. 3. Given that the assumptions of Theorem \4.2\ hold, function hi has at 
most one zero, which is positive if it exists. 

Proof. For the existence of at most one zero, it is sufficient to show that hi is 
strictly increasing. The function hi has a fixed point in 0, is positive for positive 
arguments and continuous as weU as bijective, thus it must be strictly increasing 
or, equivalently, its slope must be strictly positive. Consequently, the slope of hi is 
also positive, because 

(A.35) h'lix) = h'i{x)~^[F-^{Xo-Nxil~a^))] 



(A.36) = h'lix) +N 



dx 

1 - Ox (1 - Tp'{x)x) 



f{F-\Xo-Nx{l-a^)))' 



and the numerator of the second term is positive by assumption (I4.2ip . The posi- 
tivity of the zero (if existing) follows simply from 

(A.37) hi{0) ^ -F-\Xo) <0. 

□ 

Now, we are prepared to prove Theorem 14.21 

Lemma A. 4. Strategy is the unique minimizer of function C^^^ and all com- 
ponents of ^'^^^ are positive. 

Proof. We showed in Lemma [A.2l that there is an optimal strategy ^* = [xq, . . . , x*j^) € 
S. Thus, there must be a Lagrange multiplier S K such that 

(A.38) ^C'(i)(r) = i^ forne {0,...,A}. 

Using representation (|A.24[) of C^^\ one gets 
(A.39) 

j^C('\x) = F-\Et,^+) + a„ (1 - p'iEt,^ + )Et„+) 

OXn OXn^ 



-CW(2;)-F-i(i?wJ 



for n G {0, . . . , A — 1}. In combination with the Langrange multiplier, the recursive 
formula yields 

(A.40) F-\Et^ + ) + a„ (1 - p' iEt^+)Et,^+) [ly - F-\Et^^,)] - 

.A4n ^ _ F'HEt,^ + ) - a» (1 - p'{Et„ + )Et,^+)F-\a,,Et,^+) 

(,A.4ij ^v- — — — r ^ hi{Et^ + ) 

1 - a„ (1 - p'{Et„+)Et,^+) 

for n G {0, . . . , N — 1}. The function hi is bijective by assumption, and thus, 

(A.42) x*o = h^\iy) 

(A.43) < = (l-ao)a;S forne {1,...,A-1} 

(A.44) x% = Xo-x*o-iN -l)x*o{l-ao). 
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Therefore, the optimal strategy ^* is completely defined if we can determine Xq. 
By (|A21, 

C^^\x*) = G{x*o)-G{0) + {N -l)[G(aox* + {l-ao)x*)-G{aox*)] 
+G{aox* +Xo-x*-{N- 1)(1 - ao)x*) - G(aoa:S) 
(A.45) = N [G{x*) - G{aox*o)] + G{Xo - N{1 - ao)x*) - G(0) 

=: Cq \xq). 

We know that Cq^^ has a minimum because of Lemma IA.21 We can find it by 
differentiation: 

(A.46) ^^o'^(^) 

= N[F'\x)~a,[l-Tp'ix)x]F-\a,x) 

- (1 - a,[l - Tp'{x)x]) F-\Xo - N{1 - a^)x)] 
= N {1 - a^ll - Tp'{x)x])hi{x). 

Assumption (|4.21l) and Lemma [A. 31 tell us C^^-* has exactly one minimum, and this 
minimum is positive. We have established the uniqueness and representation of the 
optimal strategy. 

It remains to show that all components of x* are positive. We already know that 
Xq > 0. The positivity of x* follows from (|A.43j) for all n e {1, . . . , - 1}. For 
the last order, x^, observe that (|A.46p vanishes in Xq. Furthermore, F^^ is strictly 
increasing, and thus, 

= F-\x*)^ao{l-Tp'{xl)x*)F-\aox*) 

(A.47) - [1 - ao(l - Tp'{x*o)x*)] F'^Xo - N{1 - ao)x*) 

" V ' 

(A.48) > [l-ao{l-Tp'{x*o)x*)][F~\aox*o)^F-'{aox*+x*r^)], 

which, indeed, implies the positivity of x*j^. □ 

A. 2. The optimal strategy for Version 2. In this section, we determine the 
unique minimizer of C^^-* in S. For ^ — {xq, . . . , xn) & S, we have 

(A.49) ^ V / xf{x)dx 

N 

= ^(G(.T„ + i^(AJ)-i?(Aj) 

Lemma A. 5. The function C^^^ has a local minimum in 5. 
Proof. Again, it suffices to show 

(A.50) G(2)(^)^oofor ||eiU->oo. 
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We rearrange COQ]) and get 



(A.51) 



N 



n=0 



= FiaNF-\xN + FiDt^))) 



+ (^F{F-\xn + F{DtJ)) - F{anF-\xn + i^(AJ))) 

ri=0 
N 

> {FiF~\^n + F{DtJj} - F{anF-\xn + F{DtJ})'^ 

n=0 

A lower bound for the last line of (jA.51|) is given by 



(A.52) 



F{x) - F{a,x) 



zf{z)dz 



> inf fiy) 



zdz 



= 7;{l-c^l)^^ inf J{y) > 0. 
Because of the assumptions (|4.14p and (I2.17p . we know 
(A.53) mi f{y). 

tends to infinity for |a;| — >■ oo. Finally, we introduce the mapping 
(A.54) Tix) := {xo,xi + F{Dt,), ...,xn + 

for which C^^\x) > H{\\T{x)\\aa) holds. It remains to show that ||T(a;)||oo — > oo 
for \x\ oo. Let us assume there is a sequence x'^ such that ||x'°||oo oo but 
||T'(a^'')||oo remains bounded. This implies especially the boundedness of (xq). But 
then again, D^_^ = aQF^^{xQ) remains bounded. We can continue the argumen- 
tation for all coordinates of T{x) and conclude that (x^) is a bounded sequence 
for all n S {0, ...,A^}. This contradicts the assumption, and thus the lemma is 
proven. □ 

Lemma A. 6. Under the assumptions of Theorem \4-.l\ equation {4-16^ has at most 
one solution, which is positive if existing. Furthermore, g{x) :— f{x) — dxf{axx){l — 
Tp'(x)x) is positive. 

Proof. We show that both /12 o F^^ and 

(A.55) h2{x) := -F-^ {Xo ^ N [x - F {aF-iix)F-\x))]) 

are strictly increasing. In this case, at most one zero can exist, and its positivity 
is guaranteed by /i2(F~i(0)) = and /i2(0) = -F{Xo) < 0. The function /i2 is 
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strictly increasing because it is continuous, bijective, has a fixed point at zero and 



(A.56) 
(A.57) 



lim 

e->-0 



h2ie)-h2{0) ^ ^.^^^/(e)-a2/(a,e)(l-Tp'(e)6) 



o/(e)-aJ(a,e)(l-rp'(e)e) 



1-do 



> 0. 



Since F ^ is also strictly increasing, we have proven the same property for h2°F ^ . 

We differentiate /i2: 

(A.58) 

, , , , 'fiF'H^)) - ap-i(,)/(ap-i(,)F-i(a;))(l - rp'(F-i(a;))F-i(a;))' 
h^ix) = N 



/(F-i(x))/ (F-i (Xo - TV [a; - F(a^-i(,)f )) 



This expression is strictly positive because the numerator is strictly positive as we 
show next. We define both 



(A.59) 



k{x) := f{x) - axf{axx){l - Tp'{x)x) and 
hix) ■■= ,f{x) - alf {d^x){l - Tp'{x)x). 



The numerater of (|A.58|) can be expressed by k{F^^{x)), and furthermore, h2{x) = 
xk2{x)/k{x). Both functions k and k2 are continuous, and due to the properties of 
h explained in the beginning of the proof, the functions must have the same sign 
for all a; G M. The function k2 is greater than k for all a; G K; thus, there can be 
no change of signs and we have either k[x) > and k2{x) > or k{x) < and 
^2(2^) < for all X. Because fc(0) — /(0)(1 — ao) > 0, positivity is proven. □ 



Lemma A. 7. For all n G {0, . . . , N — 1}, the partial derivatives of C*-^-* can be 
expressed by 



C"^ >{x) = Dt„+-\ — r 

OXn /(A„ + ) 



d 



dXn+l 



Proof. First, observe 



(A.60) 



d 

dXn 



0'nf{,Dt„ + ,) 



(l-rp'(A„+)A„ + ) 



dXn 



-Dt 



+1 



for ?i e {0, . . . , m — 2}. This follows from 
d 



Dt^ (A.61) 

[a™_iF-i(x„_i +F{... {anF-\xn + i^(Aj)) .•■))] 



dX; 

_d 

dX; 

n 

,k=n+l 



d_ 

dx 



fiDt„,Jg^D, 

OXn+l 



aF-^Xk+F(x))F ^{xk + F{x)) 
d „ 1 ra„(l-Tp'(A„+)A„+) 



_d_ 

dXn 
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We use (|A.60|) and (|A.49| for the transformation 
d 



(A.62) 



dXn 



C(2)(x) 



N 



d 



F~\xn + F{DtJ)+ J2 TT- G{x.,n+F{DtJ)^ F{Dt 

UXn L 

m— n+1 

d 



N 



D 



m— n+l 



dXn 



[F~\x^ + FiDtJ)-DtJ 



D 



[1 - Tp'(A,.+)A„+] (a„+i+ - A„+i 



m— n+2 



i9a;„+i 



Now, the same calculation for dC'-^\x)/dxn+i results in 
(A.63) 



N 



d 



dXn+l 



and combining (IA.62P and (|A.63I) yields the desired result 



[F-\x^ + F{DtJ)-DtJ 



□ 



Finally, we are prepared to prove Theorem 14. II 



Lemma A. 8. Strategy is the unique minimizer of function C*-^' and all com- 
ponents of S}-"^^ are positive. 

Proof. Lemma [A . 5 1 guarantees the existence of at least one optimal strategy ^* G S. 
By standard arguments, there is a Lagrange multiplier e R such that 

(A.64) = forne {0,...,iV}. 



We use Lemma [A. 71 to get 
(A.65) 



(A.66) ^v = D 



f{Dt,^+) - a2/(a„A„+)(l - rp'(A„+)A„+) 



" - a„/(a„A„+)(l - rp'(A„+) A„+) 

for n G {0, . . . , N ~ 1}. Function /12 is one-to-one, and thus, 
(A.67) 1^ ^ h2{F-\xl + F{DtJ)) 

implies that x* -I- F{Dt^) does not depend on n g {0, . . . , iV — 1}. Consequently, 
Dt^+ = F~^(x,* -I- F{Dt^)) is constant in n such that we can conclude 

(A.68) xl = F{h^\v)), 

(A.69) = a;5-F(A„)=a;5-F(ao^^"'K)) for n £{!,..., ^-1}, 
(A.70)x^ = Xo-x5-(iV-l) [xS-i^(ao^^-i(x5))] . 
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The value Xq determines the optimal solution completely, and thus, it must mini- 
mize 

{xo, Xo~F {aoF-^xo)) , . . . , - - (iV - 1) [xq - F{aoF-\xo))] ) 
^ Gixo) + J2 [^(^o) - F{aoF-\xo)) 

+ G(Xo - iV[xo - F{a^F-^{x^))\) - F{aoF-\xa)) 
= N[Gixo) ~~ F{aoF-\xo))] + G(Xo - N[xo - FiaoF-^xo))]). 



Differentiation results in 



(A.71) 



dC^^\xa) 
dxo 



= N 



^0+ ^ ^0-^0+ 



a-o 



fiDo+) 



(1 - Tf5'{Do+)D,, 
(1 - Tp'iDo+)Do+) 



such that we can calculate the minimizer by 

d (-.(2) 

The left hand side of the last line can be rewritten as 



f{Do+)-alf{Dt^)il-Tp'iDo+)Do+) 
0+ f{Do+)-aofiDt^){l-Tp'{Do+)Do+) ' 



(A.73) A„+ = 

- + Xo - - (TV - l){x* - 

= F-i(Xo-7VK-F(Aj) 

and the right hand side is just h2{F~^{xQ)). We know by Lemma fA.SI that equation 
(IA.72P has at most one zero such that we are finished with the existence, uniqueness 
and representation of the optimal strategy. 

At last, we show that all components of this strategy are positive. We already 
know Xq > and thus also x* > for all n e {1, . . . , - 1} by (|A.69|) . For the 
positivity of , we transform (|A.72I) into 
(A.74) 

ao/(ao-Do+) - ag/(aoL'o+) 



D 



tjv + 



{l~Tp'{Do+)Do, 



f{Do+) - ao/(aoAoJ(l - Tp'iDo+)Do+) 
The fraction on the right hand side is strictly positive by Lemma lA. 61 positivity of 



follows from 



(A.75) 



D 



tjv + 



> Do 



ao 



> Dt 



□ 
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